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(57) ABSTRACT 

Systems and methods for augmenting the performance of 
iterative soft decision-in soft decision-out decoding of block 
codes with extrinsic information based on multiple parity 
equations inherent to the block codes. Cyclic shifting of 
codewords may be applied in the context of iterative soft 
decision-in soft decision-out decoding to maximize the 
usefulness of a parity equation corresponding to any par- 
ticular codeword bit. Soft decisions are determined on a 
bit-by-bit basis in response to multi-bit symbol measure- 
ments. This allows the use of relatively inexpensive bit- 
based decoders for decoding of multi-bit symbols. 
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ITERATED SOFT-DECISION DECODING OF 
BLOCK CODES 

This is a continuation of application Ser. No. 09/253,146 
filed Feb. 18, 1999, now U.S. Pat. No. 6,499,128, which is 
hereby incorporated by reference. 

BACKGROUND OF THE INVENTION 

The present invention relates to digital communication 
and storage systems and more particularly to systems and 
methods for error control. 

Error correcting codes insert redundancy into digital 
information streams so as to reduce susceptibility to noise. 
Applying an error correcting code at the transmitter permits 
the receiver to detect and sometimes correct errors induced 
by noise and/or interference. Some popular types of error 
correcting codes include convolutional codes, block codes, 
and Reed Solomon codes, etc. 

An important recent development in the topic of error 
correcting codes is the discovery of "turbo" codes. These 
codes typically involve an iterated combination of two or 
more systematic convolutional codes (codes where the 
encoder output bits include unaltered input bits.) A key 
feature of turbo codes is the use of an iterated decoding 
technique where each successive decoding step outputs soft 
decisions usable as input to the next decoding step. By 
employing turbo codes, one may approach the limit of 
channel capacity in the presence of noise set by the Shannon 
theorem. 

Further work has been done to exploit similar iterated 
combinations as applied to systematic block codes. See 
Hagenauer, Iterative Decoding of Binary Block and Convo- 
lutional Codes, IEEE Transactions on Information Theory, 
Vol. 42, No. 2 (March 1996), the contents of which are 
herein incorporated by reference. What is needed are decod- 
ing techniques that allow even closer approach to the limit 
without undue increase in complexity. It is furthermore 
desirable to implement the decoder with inexpensive com- 
ponents to the extent possible. 

SUMMARY OF THE INVENTION 

In one embodiment, the present invention augments the 
performance of iterative soft decision-in soft decision-out 
decoding of block codes with the use of information based 
on multiple parity equations inherent to the block codes. 
Another aspect of the present invention employs cyclic 
shifting of codewords in the context of iterative soft 
decision-in soft decision-out decoding to maximize the 
usefulness of a parity equation corresponding to any par- 
ticular codeword bit. Yet another aspect of the present 
invention determines soft decisions on a bit-by-bit basis in 
response to multi-bit symbol measurements. This provides 
more coding gain than symbol-by-symbol soft decisions. 

According to a first aspect of the present invention, a 
signal processing system includes a receiver system that 
receives a series of codewords that have been coded accord- 
ing to an iterative block coding procedure, and a decoder 
that decodes the series of codewords according to an itera- 
tive decoding procedure. At least one iteration of the decod- 
ing procedure forms estimates of codeword bits based in part 
on at least two parity equations inherent to a block code 
employed in the iteratively applied block coding procedure. 

According to a second aspect of the present invention, a 
method for estimating bit-by-bit soft decision value in a 
digital communication system where multibit symbols are 
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communicated is provided. The method includes receiving a 
multibit symbol, for a particular bit of the multibit symbol, 
evaluating a first Euclidean distance between the multibit 
symbol and a closest ideal symbol for which the particular 

s bit has value "1", evaluating a second Euclidean distance 
between the multibit symbol and a closest ideal symbol for 
which the particular bit has value "0", determining a soft 
decision value for the particular bit based on the first 
Euclidean distance and the second Euclidean distance, and 

10 using the soft decision value as a basis for an iterative 
decoding process. 

Other features and advantages of the invention will 
become readily apparent upon review of the following 
detailed description in association with the accompanying 

15 drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 depicts an-exemplary data communication system. 

20 FIG. 2 depicts an exemplary serial concatenated block 
coder according to one embodiment of the present invention. 

FIG. 3 depicts a product code as would be implemented 
by the serial concatenated block coder of FIG. 2 according 
to one embodiment of the present invention. 

25 FIG. 4 depicts a procedure for cyclically shifting code- 
words to augment extrinsic information available from par- 
ity equations according to one embodiment of the present 
invention. 

FIG. S depicts an iterative soft decision-in soft decision- 
30 out decoding procedure according to one embodiment of the 
present invention. 

FIG. 6 depicts a parallel iterative block coder according to 
one embodiment of the present invention. 
35 FIG. 7 depicts a procedure for obtaining soft decisions for 
received bits based on received symbol estimates according 
to one embodiment of the present invention. 

FIG. 8 depicts the use of Euclidean distances in the 
procedure of FIG. 7 according to one embodiment of the 
40 present invention. 

FIG. 9 depicts a system for exploiting multiple antennas 
in conjunction with iterative decoding procedures according 
to one embodiment of the present invention. 

DESCRIPTION OF SPECIFIC EMBODIMENTS 

45 

The present invention will be described to specific 
embodiments. It will be understood that the procedures 
described herein may be implemented with any kind of 
hardware including, e.g., ASICs, custom VLSI, FPGAs, etc., 

50 any kind of software including, e.g., C, assembly language, 
assembly language for DSP processors, etc., or any combi- 
nation of digital or analog hardware or software. 
Exemplary Data Communication System 

FIG. 1 depicts an exemplary communication system 100 

55 that may take advantage of the coding and decoding systems 
and methods provided by the present invention. A data 
source 102 originates data to be communicated. To improve 
quality of reception, the data is encoded by a channel coder 
104. Prior to transmission across a channel 108, the channel 

60 coded data may be subject to further signal processing and 
is modulated onto a carrier by a transmission signal pro- 
cessing element 106. The carrier is appropriate to channel 
108. The present invention is not limited to any modulation 
scheme but may operate in conjunction with, e.g., QAM, 

65 OFDM, CDMA, etc. 

On a receiver end of channel 108, a receiver signal 
processing element 110 demodulates channel coded data 
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received from the channel and may apply further processing. 
The input to a channel decoder 112 represents estimates of 
the output of channel coder 104. The channel decoder 112 
uses the coded data to form estimates of the data provided 
by data source 102 and sends these estimates to a data sink 
114. 

Data source 102 may incorporate source coding for com- 
pression. The effect of such source coding may be removed 
by a matching source decoder within data sink 114, 

Channel 108 may be any kind of channel including any 
type of transmission medium including, e.g., a wireless 
transmission medium, fiber optics, cable, twisted pair, tele- 
phone line, etc. Channel 108 may also represent storage and 
later retrieval of data such as from a magnetic or optical 
storage medium. Channel 108 may also include components 
such as antennas, filters, amplifiers, etc. 
Serial Concatenated Block Coding 

Channel coder 104 adds redundancy to the received data 
to facilitate error-free transmission. One channel coding 
scheme is a serial combination of block coders to form a 
so-called product code. FIG. 2 depicts an exemplary serial 
concatenated block coder 200 that may be used to imple- 
ment channel coder 104. 

A first block coder 202 applies a block code according to 
a first block coding scheme. Examples of possible block 
coding schemes include, e.g., Hamming codes, Reed- 
Solomon codes, etc. The block coding scheme employed is 
preferably a so-called "systematic code." This means that 
the output of block coder 202 is a stream of codewords 
where each codeword includes one or more data bits from 
the input and one or more parity bits which are obtained by 
block coder 202 based on the input. 

An interleaver 204 interleaves the codewords output by 
block coder 202 according to an interleaving scheme. Many 
interleaving schemes are well known in the art such as e.g., 
block, helical, convolutional, or pseudo-random, etc. Inter- 
leaving schemes are described in, Wicker, Error Control 
Systems for Digital Communication and Storage (1995), the 
contents of which are herein incorporated by reference. 

After interleaver 204, a second block coder 206 applies a 
second block coding scheme to the interleaver output to 
provide a second stream of codewords as the output of 
channel coder 104. Block coder 206 may implement the 
same block coding scheme as block coder 202 or a different 
block coding scheme. 

The overall operation of serial concatenated block coder 
200 may be referred to product coding. The operation of 
product coding will be explained in greater detail with 
reference to FIG. 3. 

FIG. 3 depicts an array 300 of codewords as would be 
present at the output of serial concatenated block coder 200 
if interleaver 204 employs a block interleaving scheme with 
a (7,4) code, i.e., a code that outputs codewords including 4 
input data bits and 3 parity bits. In this arrangement, d^, are 
data bits and are parity bits, with the subscript r denoting 
the row and c denoting the column. The first four rows of the 
matrix each represent a codeword output by first block coder 
202. Each column represents a codeword output by second 
block coder 206. The first coding scheme employed by first 
block coder 202 may be referred to as the row code. The 
second coding scheme employed by second block coder 206 
may be referred to as the column code. 

In the depicted example, the input to first block coder 202 
is the submatrix defined by the intersection of the first four 
rows and the first four columns. The output of first block 
coder 202 corresponds to the first four rows in their entirety. 
The operation of interleaver 204 causes the input to block 
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coder 206 to be presented serially but column-by -column. 
The parity bits in the lower right corner are column-code - 
parity computed on the row code's parity. The row code and 
the column code need not be the same code; if they are of 
different block lengths, the matrix is rectangular rather than 
square. According to the present invention, at least one of the 
row code and the column code may employ multiple parity 
bits. In the depicted example, each code employs 3 parity 
bits. 

A similar effect may be produced with different interleav- 
ing schemes although the results would not be visualized in 
the same way. It will be appreciated that further intereavers 
and block coders may be serially concatenated to the 
arrangement shown in FIG. 2. The effect is to add "dimen- 
sions" to the two dimensional scheme depicted in FIGS. 
2-3. 

Decoding the Serial Concatenated Coding Scheme 

For a two-dimensional product code arrangement, decod- 
ing may proceed by first decoding the rows, then using the 
corrected rows as input for decoding the columns. This 
procedure can be iterated, resulting in the correction of 
additional errors. It will be appreciated that such a decoding 
scheme may be extended to multiple dimensions. 

According to one embodiment of the present invention, a 
decoding scheme may take advantage of so-called soft 
decisions for bit values both at the input and at successive 
decoding iterations. A soft decision for a bit value is not 
simply a "0" or a "1" but rather an estimate of the likelihood 
that the bit has been transmitted as either a "0" or a "1." 

According to one embodiment of the present invention, 
the decoding scheme may take advantage of relationships 
between the parity bits and data bits that are imposed by the 
particular block coding schemes used. 

Certain decoding schemes provided by the present inven- 
tion may be more readily understood in light of background 
information concerning the relationships between parity bits 
and data bits. Many popular block codes, e.g., BCH codes 
including Hamming codes and Reed-Solomon codes are 
linear codes. A linear code is the null space of a matrix H, 
known as the parity check matrix. For BCH codes, the H 
matrix has a specific well-defined structure. 

For example, the H matrix for a binary systematic Ham- 
ming code with block length n has the structure: 

H-{ar l ar 2 cr 3 . . . a 3 a 2 a 1] 

where a is a primitive element of the finite field GF(2 m ), 
n S2 m -l. Other BCH codes (including Reed-Solomon 
codes) have comparable structures. However, more 
generally, any linear code can be described by an H 
matrix. The rows of the H matrix define a set of parity 
equations that describe the inter-relationships between 
the bits of a codeword imposed by the code structure. 
A further discussion of block coding theory may be 
found in Wicker, Error Control Systems for Digital 
Communication and Storage (1995), the contents of 
which are herein incorporated by reference. According 
to the present invention, interrelationships provided by 
the parity check matrix may be explicitly used to 
develop multiple estimates of a given code bit. 
A specific example will now be used to illustrate the 
application of the parity equations to iterative soft decision 
decoding according to one embodiment of the present inven- 
tion. Consider the (7,4) Hamming code. The H matrix for 
this code is: 
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and Xq. This H matrix defines the following parity check 
equations: 

x 5 ©x 4 ©x 3 ©x 1 «»0 
x^x s ®x J ®x o '0 

where © signifies modulo-2 addition. From these 
equations, a number of bit inter-relationships can be 
inferred. For example, given a codeword, the following 
relationships can be seen for x 6 : 

Given estimates of all the bits in the codeword, we thus 
have 3 independent estimates of bit x 6 , namely x 6 itself plus 
the preceding 2 equations. 

The soft decision value for each bit is preferably propor- 
tional to the logarithm of the likelihood ratio for that bit, e.g., 
the value of the likelihood that a "1" was transmitted for that 
bit over the likelihood that a "0" was transmitted. According 
to one embodiment of the present invention, one may refine 
the soft decision value estimate for a particular bit with 
information provided by parity equations. 

Each parity equation may provide a supplemental soft 
decision value for bit x 6 . For each parity equation, we 
estimate the supplemental soft decision value to be the 
log-likelihood ratio for the value given the right side of the 
parity of equation. Thus, it is desirable to compute the log 
likelihood ratio for an exclusive-or of a number of bits, 
given the log likelihood ratios of each of the bits individu- 
ally. The log likelihood ratio for a modulo-2 sum of 2 bits 
(say, x^Xy, with log likelihood ratios L&) and L(x y )) is 
approximately given by: 

L(x,ex J )^gn£(x$-sgn<!,(x J )>m^ 

According to the present invention, this result may be 
extended to more than two bits. By induction, it can be 
shown that the log likelihood ratio of a modulo-2 sum of 
several bits is approximately given by the product of the 
signs of the log likelihood ratios of the individual bits times 
the minimum of the magnitudes of the log likelihood ratios 
of the individual bits. (Note that the sign of the log likeli- 
hood ratio of a bit is simply the so-called hard decision for 
that bit.) 

Considering again x 6 as an example, there are 3 ways of 
estimating the likelihood ratio of x 6 , namely L(x 6 ), 
L(x 5 ©x 4 ®X2), and L(x 3 ©x 3 ©x 0 ). We then have: 

/.(jfjiJ-the soft decision value of bit x 6 
L(x 5 ex 4 ex^gn{L(x s )yssril(x 4 ))sgn{L^ 

L(x s ®x y ex^gn(L(x 5 ))sgn(L(xjysgn(L(xJ)^ 

In these equations, L(x ; ) is the soft decision value for bit 
x,- The values of L(x 5 ©x 3 ©Xo) and L(x5©x 3 ©Xq) are 



referred to herein as extrinsic information and provide 
independent supplemental estimates of the log likelihood 
ratio of x 6 in addition to L(x 6 ). An extrinsic value is then 
obtained as some combination of L(x 5 ©x 3 ©x 0 ) and 
L(x 3 ©x 3 ©x 0 ) and may then be used as a priori information 
that is input into the next stage of decoding. Because of the 
interleaving between the constituent codes, the extrinsic 
information at a given stage in the iterative decoding process 
provides new and independent information to the next stage. 

According to one embodiment of the present invention, 
multiple parity equations are exploited in forming soft 
decision estimates. Also, according to the present invention 
one may take advantage of the extrinsic information in 
various ways to form input for the next decoding step. An 
extrinsic value E(x^) may be formed as a weighted or 
non-weighted sum of the supplemental soft decision values 
generated in accordance with the parity equations as 
explained above. In a given decoding step, the new soft 
decision value L^x^) may be determined based on various 
20 combinations of the pre-decoding soft decision value and the 
extrinsic value generated based on the parity equations. 

For example, one could apply the formula L^x^L^^ 
a-(E(x i )) for some parameter a. The parameter a may be 
optimized to improve performance. Alternatively, one may 
25 apply the formula LXx^pL^+a^x,-)) for a pair of 
parameters a and p. According to the present invention, 
these decoding techniques may be applied iteratively for the 
two or more block codes employed in the serial coding 
scheme. 

30 In one embodiment, the values of a and/or p may vary on 
a per iteration basis. For example, the value of a may be a 
function of the decoding iteration number, k so that 

V{x ( )-L(x^*{k)(E(xfi 



In the original iteration, the previous soft decision value 
L(x t ) may be obtained from the output of receive signal 
processing element 110. Where the output of receive signal 
processing element 110 is in the form of multi-bit symbol 
soft decision estimates, a constellation bit mapping tech- 
nique described with reference to FIGS. 7-8 may be used to 
45 obtain the original soft decision value for each bit. 

Thus, in any one iteration, a soft decision value is output 
for each bit. For bits where no parity information is 
available, the soft decision output value may be the same as 
the soft decision input value. For bits where parity infor- 
50 mation is available, one may take advantage of any of the 
above techniques to refine the input soft decision value with 
extrinsic information. 

Another variation provided by the present invention takes 
advantage of the cyclic symmetry of many block codes 
55 including all Hamming codes and BCH codes. In a cyclic 
code, cyclically shifting any codeword results in another 
codeword. In the example above, it can be seen that x 6 , x 4 , 
and x 3 are each involved in 2 parity equations, while x s 
appears in all 3 parity equations. This implies that there is 
60 more extrinsic information available for bit x 5 than for the 
other bits. This property can be exploited by making use of 
the cyclic property of the code. Therefore, the codeword can 
be cyclically shifted, 1 bit at a time, so that each bit in turn 
is placed into the X5 position for decoding. With this 
65 technique, each bit will have the maximum possible amount 
of extrinsic information to be combined into a priori infor- 
mation for the next iteration. 
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Equivalently, the H matrix rows can be cyclically shifted, 
resulting in a cyclically-shifted set of parity equations such 
that each bit appears in a set of 3 equations. This technique 
may simplify a serial implementation of the decoding 
implementation, since a single set of extrinsic calculators 
(corresponding to 1 bit's parity equation set) can be used and 
the bits cycled through it. 

FIG. 4 depicts a procedure for cyclically shifting code- 
words to augment extrinsic information available from par- 
ity equations according to one embodiment of the present 
invention. At step 402, extrinsic information is obtained for 
a designated bit position of a codeword based on the parity 
equations for that bit position. This designated bit position is 
preferably chosen to be the one having the maximum parity 
information. At step 404, the new soft decision value for the 
bit in the designated bit position is obtained based on a 
combination of the extrinsic information and possibly the 
previously obtained soft decision value for that bit by any of 
the methods described above. At step 406, the codeword is 
cyclically shifted by one bit so that a new bit shifts into the 
designated bit position. At step 408, extrinsic information is 
obtained for the bit shifted into the designated bit position. 
At step 410, a new soft decision value is generated for this 
bit. Step 412 tests whether cyclic shifting through the 
codeword is complete. If yes, then one iteration of decoding 
for this codeword is complete. If no, processing returns to 
step 406 for the next cyclic shift. 

FIG. 5 is a flowchart depicting an iterative soft decision-in 
soft decision-out decoding procedure according to one 
embodiment of the present invention. FIG, 5 represents an 
overall procedure of which the above -described decoding 
techniques may represent a part. Step 502 represents decod- 
ing of a series of input bit soft decision values according to 
the first block coding scheme, e.g., a row code. The inputs 
to and outputs from step 502 are soft decision values for 
each codeword bit. The outputs may be generated by any of 
the techniques described above. The output values are 
subject to a de-interleaving step 504 which represents the 
inverse of the interleaving procedure applied by interleaver 
204. The output of de-interleaving step 504 is again a series 
of soft decision values which are then the input to a decoding 
step 506. Step 506 decodes according to the second block 
coding scheme, e.g., a column code. 

Each iteration of steps 502 and 506 generates new soft 
decision values for the data bits. One criterion for stopping 
the iterative process is convergence of the soft decision 
values. Convergence is tested at step 508. If the soft decision 
values are converging according to a numerical convergence 
criterion, then hard decision values are generated at step 
510. In one embodiment, hard decision values may be 
generated simply by taking the sign of the log likelihood 
value for each bit. If the convergence criterion fails, pro- 
cessing returns to step 502 for further iteration. Other criteria 
are possible, such as, e.g., completion of a fixed number of 
iterations. In the context of block interleaving, the procedure 
of FIG. 5 can be understood with reference to FIG. 3 to 
consist of an alternating series of row decoding steps and 
column decoding steps. 

It will of course be appreciated that, according to the 
present invention, these decoding techniques are easily 
extendable to serial combinations of more than two block 
codes. 

Parallel Iterative Block Coding and Soft Decision-In Soft 
Decision-Out Decoding 

The decoding techniques described above may also be 
applied to parallel concatenated codes. FIG. 6 depicts a 
parallel iterative block coder according to one embodiment 
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of the present invention. A first block coder 602 operates 
according to a first block coding scheme. The first block 
coding scheme is a systematic code so the effect is to 
produce one or more parity bits to correspond to a series of 
one or more data bits. The data input to block coder 602 is 
also fed to an interleaver 604. Choices of interleaving 
scheme include, e.g., block interleaving, helical 
interleaving, convolutional interleaving, and pseudo- 
random interleaving, etc. The output of interleaver 604 is fed 
into a second block coder 606 which operates according to 
a second block coding scheme. The second block coding 
scheme is also systematic and may or may not be the same 
as the first block coding scheme. Second block coder 606 
also generates one or more parity bits. A combination 
element 608 combines the data bits with the parity bits 
generated by each block coder to form a series of code- 
words. Because the parity bits output by second block coder 
606 will not be in sync with the original data bits, the output 
codewords generated by combination element 608 are sig- 
nificantly longer than the output codewords generated by 
either block coder individually. 

Codewords generated in this way may be iteratively 
decoded according to any of the variations of soft decision 
input/soft decision output decoding scheme as described in 
reference to the serial iterative coder. For the parallel 
scheme, the set of parity bits exploited alternates with each 
iteration of steps 502 and 506. As with the serial iterative 
coding scheme, the parallel techniques may also be extended 
to more than two dimensions by adding further parallel lines 
of interleaver and block coder. 

Soft Decision Values for Bits in Symbol-Based Systems 

The decoding techniques above make use of soft decision 
values for individual bits. The first decoding iteration takes 
as an input bit soft decision values as would be generated by 
receiver signal processing element 110. In many communi- 
cation and data storage systems, however, multi-bit symbols 
are communicated and the receiver output may be series of 
estimates for the values of these symbols. It is possible to 
decode on a symbol-by-symbol basis but the bit-based 
decoding techniques disclosed herein are simpler and less 
costly to implement. 

According to the present invention, one may obtain soft 
decision values for individual bits based on received esti- 
mates of symbol values. FIG. 7 depicts a procedure for 
obtaining soft decisions for received bits based on received 
symbol estimates according to one embodiment of the 
present invention. * FIG, 8 depicts the use of Euclidean 
distances in the procedure of FIG, 7 according to one 
embodiment of the present invention. 

In FIG. 8, a received value for a two bit symbol is 
illustrated as a star 802 on a two-dimensional constellation 
804. In constellation 804, there are four ideal symbol values 
806 corresponding to the possible transmitted values of the 
symbol. Each ideal symbol value represents two bits as 
marked. 

At step 702, the estimated symbol value is received. At 
step 704, the Euclidean distance to-the nearest symbol 
having the value "1" for a particular bit is evaluated. For the 
left bit, this is distance d^l) as shown in FIG. 8. At step 
706, the Euclidean distance to the nearest symbol having the 
value "0" for this particular bit is evaluated. For the left bit, 
this is distance d 2 (0) as shown in FIG. 8. At step 708, the two 
Euclidean distances are subtracted to obtain an initial soft 
decision value for the particular bit. Step 710 tests whether 
soft decision values have been obtained for every bit in the 
symbol. If they have been obtained, the procedure is com- 
plete for that symbol. If they have not been, the procedure 
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returns to step 702. For example, for the second bit of the 

received symbol in FIG. 8, the soft decision value will be the 

difference of the Euclidean distances d 2 (l) and 0^(0) as *<*) : 

shown. 

Furthermore, the soft decision decoding techniques may 5 
also be used in conjunction with a receiver system that 
employs multiple antennas or other multiple connections to 
the channel output. FIG. 9 depicts a receiver system 900 
employing multiple antennas according to one embodiment 
of the present invention. 10 

Receiver system 900 collects signals from a plurality of 
antennas 902. In FIG. 9, two antennas are shown, although 
any number of antennas may be used. Many components 
depicted in FIG. 9 are duplicated for each antenna. 

Each antenna 902 is coupled to a downconversion system 15 
904 which performs analog filtering, amplification, down- 
conversion to an intermediate frequency (IF), conversion to 
a digital baseband sample stream, and further digital filtering 
and conditioning. The output of each downconversion sys- 
tem 904 is a time domain symbol sequence. 20 

Some of the transmitted symbols are training symbols that 
have predetermined values known at the receiver. Channel 
estimation processors 906 calculate the magnitude and phase 
of the channel response as measured via each antenna by 
comparing the known transmitted training symbol values 25 
and the actual values of the training symbols as received. 
Alternatively, the channel estimate may be based on feed- 
back data obtained from the other side of the link. 

Symbol estimation processors 908 form initial estimates 
of transmitted symbols, z t {k), using the channel response 30 
estimates by applying the expression 



10 



and where j(k) is a vector representing the time domain 
symbols received via all M R antennas and where h (k) is a 
vector representing the channel response estimates for all 
M R antennas. 

Assuming that each symbol z(k) has m bits, a cost metric 
value processor estimates a soft metric cost value for each 
bit r at each time index value k to be: 

or alternatively: 

c rk = [i\k)R- w l ik)kk)l[^(0) -<&(!)] 



where k is a frequency domain index, i identifies a 
particular antenna, hfit) is a channel response estimate 
based on signal received via channel output i, x,(k) 
represents a received symbol at time index k received 
via antenna i. These quantities are complex scalars. The 
effect of the symbol estimation processors 908 is to 
compensate for the known effect of the channel. 
Noise and interference estimation blocks 910 form esti- 
mates of noise and interference according to the following 
expression: 



In the absence of interference, noise will dominate this 
expression. 

A statistical characterization block 912 estimates a statis- 
tical characterization of the received noise and interference 
and its distribution among the antennas. In one embodiment, 
it obtains a covariance matrix R^(k) that has M^xM^entries 5S 
where is the number of receiver antennas. The ijth entry 
of this covariance matrix is determined as E[w, (k)w/(k)] 
where i and j identify individual antennas. 

The E expectation operator may be evaluated over time. 
Smoothing may also be performed over time. A cost metric 60 
value processor 914 bases its generation of cost metric 
values on the following expression which gives a maximum 
likelihood soft decision value for each symbol: 



f(*)-**(%(A) 



where 



where d r ^ values are found from the soft decision symbol 
estimates using the procedure described in reference to 
FIGS. 7--8. An iterative decoder 916 may then apply 
any of the iterative decoding techniques described 
above to remove the effects of an iteratively applied 
convolutional code, e.g, a turbo code. 
Spatial processing as described above may be simplified 
by assuming, e.g., that noise and/or interference is uncorre- 
cted among the various receiver antennas, or further that 
noise and/or interference is not only spatially uncorrelated 
across antennas but also identically distributed. Simplifica- 
tions based on these assumptions are disclosed in the 
co-assigned application entitled IMPROVED SYSTEM 
35 FOR INTERFERENCE CANCELLATION, U.S. applica- 
tion Ser. No. 09/234,629, the contents of which are herein 
incorporated by reference. 
Conclusion 

While the above is a complete description of preferred 
embodiments of the invention, there is alternatives, 
modifications, and equivalents may be used. It should be 
evident that the invention is equally applicable by making 
appropriate modifications to the embodiments described 
above. For example, the channel coding schemes herein may 
be combined in series with other channel coding schemes. 
Therefore, the above description should not be taken as 
limiting the scope of the invention that is defined by the 
meets and bounds of the appended claims along with their 
full scope of equivalents. 
What is claimed is: 

1. A method for processing a received signal, said method 
comprising: 

receiving a series of codewords that have been codes 
according to an iteratively applied block coding pro- 
cedure; 

decoding said series of codewords according to an itera- 
tive decoding procedure wherein at least one iteration 
of said decoding procedure forms estimates of code- 
word bits based in part on estimates for at least two bits 
of a codeword, at least one of said estimates being 
based on a single parity equation for one of said bits; 
and 

wherein said at least one iteration of said decoding 
procedures forms estimates of all codeword bits based 
65 on cyclic shifting through a codeword in conjunction 
with repeated application of said single parity equation. 

2. A signal processing system comprising: 



40 



45 



50 



08/07/2004, EAST Version: 1.4.1 



US 6,725,411 Bl 



11 



12 



a receiver system that receives a series of codewords that 
have been coded according to an iteratively applied 
block coding procedure; and 

a decoder that decodes said series of codewords according 
to an iterative decoding procedure wherein at least on 
iteration of said decoding procedure forms estimates of 
codeword bits based in part on estimates for at least two 
bits of a codeword, at least one of said estimates being 
based on a single parity equation for one of said bits; 
and 

wherein said at least one iteration forms estimates of all 
codeword bits based on cyclic shifting through a code- 
word in conjunction with repeated application of said 
single parity equation. 

3. Apparatus for processing a received signal, said appa- 
ratus comprising: 

means for receiving a series of codewords that have been 
coded according to an iteratively applied block coding 
procedure; 

means for decoding said series of codewords according to 
an iterative decoding procedure wherein at least one 
iteration of said decoding procedure forms estimates of 
codeword bits based in part on estimates for at least two 
bits of a codeword, at least one of said estimates being 
based on a single parity equation for one of said bits; 
and 

wherein said at least one iteration of said decoding 
procedure forms estimates of all codeword bits based 
on cyclic shifting through a codeword in conjunction 
with repeated application of said single parity equation. 

4. A method for processing signals received via multiple 
outputs of a channel, said method comprising: 

estimating characteristics of said channel; 

statistically characterizing noise and/or interference from 
multiple channel outputs; 

forming soft decision estimates for individual bits of 
communicated data based on said received signals, said 
estimated characteristics, and results of statistically 
characterizing said noise and/or interference; and 

decoding, according to said soft decision estimates, code- 
words encoded according to a iterative coding proce- 
dure. 
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5. The method of claim 4 wherein said iterative coding 
procedure comprises and iterative block coding procedure. 

6. The method of claim 4 wherein said iterative coding 
procedure comprises an iterative convolutional coding pro- 
cedure. 

7. A system for processing signals received via multiple 
outputs of a channel comprising: 

a symbol estimation block that estimates characteristics of 
said channel; 

a statistical characterization block that statistically char- 
acterizes noise and/or interference from said multiple 
channel outputs; 

a receiver system that forms soft decision estimates based 
on said signals received via multiple signal outputs and 
based on results of said symbol estimation block and 
said statistical characterization block; and 

a decoder that decodes codewords encoded according to 
an iterative coding procedure responsive to said soft 
decision estimates. 

8. The apparatus of claim 7 wherein said iterative coding 
procedure comprises an iterative block coding procedure. 

9. The apparatus of claim 7 wherein said iterative coding 
procedure comprises an iterative convolutional coding pro- 
cedure. 

10. Apparatus for processing signals received via multiple 
outputs of a channel, said apparatus comprising: 

means for estimating characteristics of said channel; 

means for statistically characterizing noise and/or inter- 
ference from multiple channel outputs; 

means for forming soft decision estimates for individual 
bits of communicated data based on said received 
signals, said estimated characteristics, and results of 
statistically characterizing said noise and/or interfer- 
ence; and 

means for decoding, according to said soft decision 
estimates, codewords encoded according to a iterative 
coding procedure. 
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